At times there is a need to share a file or files that are greater than allowed on a wikispace or shared in e-mail. Ideally, this is in combination with providing a Backup and Recovery (BUR) resource for PCs and other devices. Here are some of our experiences summarized:
Buffalo Linkstation Duo [3Q2011] BUR and Web Sharing
RAID1 can be enabled and the SATA drives updated to at least 2TB drives, from the 2x1TB drives on the system we have
Also finally acquired a large enough (2TB) drive to be a backup target for the TS-209 and Linkstation Duo as well as for all the PCs that I have around the house. Trying to make a decision between using the TS-109, or a dumb USB SATA 3.5 case for the 2TB drive.
Linkstation Duo has a web front end (buffalonas.com) for remote access to files. The Linkstation Duo is quite hackable with ipkg repository here: http://ipkg.nas-central.org/
Needed to do some initial setup ("hacking") some ways are:
Much better rated performance than any comparable generation 2 drive NAS with drives for under $150. TS-209 was about $350 with 2x 500GB 2 1/2 years ago. The Linkstation Duo was offered on eBay for just $30 more than 2x1TB SATA drive upgrade to TS-209! Comparable and newer than TS-209 and includes buffalonas.com web service access as well as 5 client NovaBACKUP license.
Seagate Dockstar (powered by Pogoplug) [3Q2010] usable for Web Sharing, not useful for BUR without significant hacking
Excellent basic sharing device. No limits on bandwidth or file sharing, BUT effectively VERY slow using the basic service that comes with the Seagate Dockstar based on Pogoplug
Seagate discontinued in favor of GoFlex service which is an agreement with a different web service provider
allows import automatically from local USB attached storage and sharing from internet web service with ACL protections
auto-copy feature does incremental copy from USB device to local directory, then shares directly to dockstar server!
OK for streaming audio including to Blackberry! Small photos (up to 3MB) render OK, but larger ones are very slow to render
Installed with a mirrored drive set at C3HUU and a second similar mirrored drive set at home with another Dockstar.
Exploring Pogoplug Biz for better performance and ability to setup multiple userids as well as customized web interface, but about $230 extra cost with no significant increase in performance.
currently serving all sermon audio from C3HUU
no rsync compatibility, uses proprietary "Active Copy" which can be used on any USB attached storage
MS acquired a 320GB 2.5" drive that plugs into the Dockstar special dock & a second Dockstar for $25 as a backup
NOTE: you CANNOT simply replace one Dockstar with another and move the stored files over. Each file is shared with a unique URL, based in part on the Dockstar unique ID
Concern over future of Pogoplug service. If it goes belly-up, will have to move all these sermons to another service. Backup copies are easily setup using the built-in Active Copy process.
hacks exist to transform into a newer version of the Linksys NSLU2 "Slug"
though we could do better, this integrated service works well and is only $65 or so for 2 years special deal for Elon students
OK, but very selective on what is backed up and available from web site
rsync.net [3Q2010] (web site only, usable by all devices that can initiate rsync, sftp, scp in a script) selective BUR
for more experienced system programming types, better secure platform, but no anonymous access at all!
about $50/year, but can setup multiple userids and spaces, encrypts information by default
currently automated Nan & DR backup, selective 7tronics
possible to setup TS-109 or TS-209 to rsync with rsync.net?
no web sharing of documents, only via ftp, rsync, ssh, et al protocols
box.net [2006] (good for manual upload/download, lacks integration with rsync, sftp, scp, etc) Web Sharing
up to 2GB free
C3H has been using since 2006 for both personal and C3H files, especially sermon archive documents
upload experience from home wanting, but very much like Dockstar (and Pogoplug backend used by Dockstar)
no integration with any local network storage
never found any way to integrate with other devices and services other than sharing individual links, BUT as of 3Q2011 there is Google Docs integration
TS-x09 NAS integration
attempted to setup rsync to rsync.net, failed in 1Q2011, though works ok from TS-x09 to another TS-x09
auto-copy feature on USB devices re-copies EVERYTHING from external device when connected! Not an rsync! Takes too long and unable to connect remotely to anything other than another TS-xxx QNAP NAS device.
able to create custom Linux scripts, but NOT able to get cron to run (cron is managed by custom QNAP code)
no integration with any web presence other than Facebook and MySpace
disk standby mode never worked, TS-209 seems to always run hot (but has very adequate and quiet cooling fans)
Linksys NSLU2 "Slug"
Installed with custom code in 2009, but limited use as no link to web service and extremely slow device
served as a gateway to determine that the C3HUU router needed to be reinstalled by me and better attended!
attempted to use flash only for boot and data, even with hacks to minimize I/O, but far too much disk I/O for typical low-cost "camera media" and they lasted no more than a few months
no integration with any web presence
installed and used ipkg from nslu2.org
great test "appliance" for creating special function device that is small and easily installed, especially using a 2.5" hdd case.
[Originally on c3huu.org...]
There are dozens of brands and models of Network Attached Storage (NAS) devices. Summary experiences at C3HUU with several are documented here. This page is being used to collect experiences on the QNAP brand of NAS devices and USB attached "no-install" file backup devices. The dual drive TS-209 Turbo is installed at C3HUU, and the single drive TS-109a is at our IT Services Architect home. The TS-109a uses the same software as the TS-209, but with lower performance and cannot be setup in a mirrored drive configuration for increased reliability as the TS-209 is setup. Note that all attempts to share files from C3HUU over the Internet are now fruitless as whoever took over network management is not responding to requests and thus there is no adjusting the firewall to dedicate ports even for secure access (ssh or ftps).
TS-109 Experiences
At home, our C3HUU IT Services lead (MS) has a QNAP TS-109 single drive NAS which is used as a:
sFTP server
Multimedia server
Backup repository
SMB/CIFS shared NAS
Source for offsite backup to external eSATA or USB drive
attempted use as rsync server for C3H Soundroom NAS
There is the potential to add:
sFTP server (can support file transfer securely from desktop/laptop PCs)
Multimedia server, as the repository for Sermons, etc (perhaps itself sync'd with an external repository)
Other tools, such as the nano editor, in an ipkg repository
On the TS-109, upgraded microcode in March 2009 and enabled built-in SSH. This enables the admin ID to ssh in. On 2009-08-24:
Installed and enabled the Optware package including ipkg from the QPKG tab of the System Tools section of the QNAS GUI
Using ipkg, installed: nano editor and the OpenSSH package
[2011-09-12] Update from Aug2011 tested good, upgrade TS-109 before applying same upgrade to TS-209
TS-209 Experiences
At C3HUU, the TS-209 was replaced by a TS-109II for the eSata external drive support and the one-button backup reprogrammablility.
Backup repository
SMB/CIFS shared NAS
Source for offsite backup using built in sync (rsync) to external USB drive
rsync server
In November 2009, added the following to the TS-209:
Installed and enabled the Optware package including ipkg from the QPKG tab of the System Tools section of the QNAS GUI
Using ipkg, installed: OpenSSH package
rsync server
Much testing ensued in 4Q2010 trying to get the built-in replication function to work with something OTHER THAN another QNAP NAS device. This was unsuccessful, after many attempts using the GUI, and then updating to latest fixes and trying again. The replication screen allows selection of NAS or rsync server, but the protocols are NOT responsive to a standard rsync.net rsync server. However, running rsync command from within the TS-209 or TS-109 works fine to rsync.net, especially after installing the public key in the file $HOME/.ssh/authorized_keys2.
sFTP Server
Initial setup using TS-109a doesn't work with typical sftp setup for any user EXCEPT admin, but using the GoodSync product (from the authors of Roboform) to test, found that ftps:, which appears to be encrypting data over the link using a standard port 21 ftp connection works with non-admin userids. This protocol does encrypt the userid/password exchange. Since this works, one can setup laptop or desktop backup with GoodSync to securely copy to the TS-209 at C3HUU. In turn, the integrated GUI based on rsync is used to maintain backup copies on any local USB attached media, such as WD MyBook external hard drives. Rather than acquire an expensive Western Digital pre-packaged external drive, in December 2009, an external USB/eSATA 2.5" drive housing was purchased and a donated 60GB 2.5" HDD was placed in the housing.
Offsite Backup
Prior to 2004: ITS staff rotated AIT tapes in an AIT 4 tape autoloader offsite. Since 2004, when the AIT autoloader became flaky (now autoloader has been discarded as non-functioning), there has been no regular offsite backup rotation, as there was no portable media created at C3HUU. In Dec2009, an external eSATA/USB drive was acquired for use as an offsite backup of key files. Testing showed that there are several ways to use the external drive:
As an external ext3 (Linux) formatted drive with excellent performance and greater than 10GB/hour throughput
As an external NTFS formatted drive with awful performance (less than 100MB/hour throughput) but far easier to mount files on any PC
As an external FAT32 formatted drive, excellent throughput performance, but FAT32 is far less reliable than either NTFS or ext3
One option is to make sure that ext3 formatted SATA drives are readable on other Linux servers. They certainly are on my TS-109 (which is the same architecture as the QNAP TS209 at C3HUU. Will also test on other Linux boxes. But if a staff member is to try to recover files, it will have to be on NTFS (or FAT32) formatted devices. We can try FAT32, though we are VERY reluctant to do so as FAT32 format is not nearly as reliable. Perhaps creating mirrors of FAT32 drives would be better? Another option is to install this Open Source project on at least one C3HUU PC supporting ext2/ext3 on Windows: http://www.fs-driver.org/faq.html
Anyone had any experience with this?
Timings:
20GB using TS109a "backup" GUI to USB attach 60GB SATA NTFS format: 14 hours, 90% complete before stopping (though only 11GB on disk)
20GB using TS109a "backup" GUI to USB attach 60GB SATA ext3 format: 3 hours 5min, completed backup & verify
USB Backup Appliances
There have been many ITS people working in non-profits raving about the capabilities of several programs which run from USB external devices and perform very easy to initiate file backups that are also easy to recover. Here are several products we have acquired and reviewed, or volunteers working with us have reviewed:
Goodsync had an offer to users of Roboform (password vault software) that made the effective price for Goodsync approx $15/PC. This software can be setup to use any attached storage and run from the USB device (special license). MS did try this and though it works, rather than run from a dedicated USB device, 4 workstation licenses were acquired and are installed on 2 PCs at C3HUU at present. This software is intended to provide File backup and replace use of the Mirra server and Mirra client software. The USB version is also available to take to any number of PCs for backup, but relies on the physical USB flash key that the software is installed on to be present. Goodsync is more like the UNIX rsync tool than the dedicated backup software reviewed below. A bit more of a learning curve to setup than alternatives below, but can be automated and is straightforward to recover files from NAS device used for storage. RECOMMENDED and in use at C3H (2010-01-04)
Clickfree: There are many versions of this core file backup product, we tried two USB versions. Software is launched when the USB key is inserted in the PC and stops when it is ejected. We can recommend the DVD Transformer, as long as you like to use DVD or CD media or the original Clickfree Transformer which is designed for use with USB hard disks. The newer Transformer SE product also supports iPods as well as just about any USB attached storage device that you can think. Transformer products do not require the USB device to recover files, and the license is for UNLIMITED use! You just have to physically have the USB device in order to perform a backup. However, the only security here is physical security. You should lock up the backup media as there is no support for encryption or password protection. RECOMMENDED but not in use at C3H(2010-01-04)
USB Flash Backup: OK software that is licensed per PC, though installed on a USB device. Limited function compared to Goodsync, but reasonable price. RECOMMENDED but not in use at C3H(2010-01-04)
QNAP NetBak Backup: included with all QNAP NAS devices. Very simple backup tool designed primarily to manage backup from one QNAP NAS device to another. In testing, this tool is designed for NAS devices only, it would not allow file backup to a local USB device if the user wished to do that. No file versioning supported at all. NOT RECOMMENDED,OK for home(2010-01-04)
QNAP QBack-35s: One of many external drive "appliances" which integrate secure partition and backup. Like the Western Digital line, it is for one-at-a-time backup, not suited for office, multiple PC backup. NOT RECOMMENDED,OK for home(2010-01-04)
JetFlash with Fingerprint scanning: unlike the first two, this has an encryption option that is quite powerful and easy to setup, BUT installing the security software results in changes to Windows login behaviour and can cause hangups in Windows Explorer. Uninstall was not clean on either of two XP test PCs. The included backup software is very simple, NOT RECOMMENDED(2010-01-04)
Packaged Backup such as Western Digital MyBook: excellent options, for direct attach storage one PC at a time. Cost almost as much as the QNAP NAS with less function ($100+ for 320GB, which is current minimum available). So rather than deploy these at each PC, C3H ITS has elected to deploy a central NAS and configure tools to use that NAS which is then backed up periodically with the above noted inexpensive, simple removable 2.5" hard drive in inexpensive ($20) external housing. NOT RECOMMENDED,OK for home(2010-01-04)
Online "Cloud" Backup and Storage Experiences
Table of Contents
http://ipkg.nas-central.org/
and another longer post on Openpogo here on adding many ipkg's including some pre-built on this blog
[Originally on c3huu.org...]
There are dozens of brands and models of Network Attached Storage (NAS) devices. Summary experiences at C3HUU with several are documented here. This page is being used to collect experiences on the QNAP brand of NAS devices and USB attached "no-install" file backup devices. The dual drive TS-209 Turbo is installed at C3HUU, and the single drive TS-109a is at our IT Services Architect home. The TS-109a uses the same software as the TS-209, but with lower performance and cannot be setup in a mirrored drive configuration for increased reliability as the TS-209 is setup. Note that all attempts to share files from C3HUU over the Internet are now fruitless as whoever took over network management is not responding to requests and thus there is no adjusting the firewall to dedicate ports even for secure access (ssh or ftps).
TS-109 Experiences
At home, our C3HUU IT Services lead (MS) has a QNAP TS-109 single drive NAS which is used as a:There is the potential to add:
On the TS-109, upgraded microcode in March 2009 and enabled built-in SSH. This enables the admin ID to ssh in. On 2009-08-24:
TS-209 Experiences
At C3HUU, the TS-209 was replaced by a TS-109II for the eSata external drive support and the one-button backup reprogrammablility.In November 2009, added the following to the TS-209:
rsync server
Much testing ensued in 4Q2010 trying to get the built-in replication function to work with something OTHER THAN another QNAP NAS device. This was unsuccessful, after many attempts using the GUI, and then updating to latest fixes and trying again. The replication screen allows selection of NAS or rsync server, but the protocols are NOT responsive to a standard rsync.net rsync server. However, running rsync command from within the TS-209 or TS-109 works fine to rsync.net, especially after installing the public key in the file $HOME/.ssh/authorized_keys2.sFTP Server
Initial setup using TS-109a doesn't work with typical sftp setup for any user EXCEPT admin, but using the GoodSync product (from the authors of Roboform) to test, found that ftps:, which appears to be encrypting data over the link using a standard port 21 ftp connection works with non-admin userids. This protocol does encrypt the userid/password exchange. Since this works, one can setup laptop or desktop backup with GoodSync to securely copy to the TS-209 at C3HUU. In turn, the integrated GUI based on rsync is used to maintain backup copies on any local USB attached media, such as WD MyBook external hard drives. Rather than acquire an expensive Western Digital pre-packaged external drive, in December 2009, an external USB/eSATA 2.5" drive housing was purchased and a donated 60GB 2.5" HDD was placed in the housing.Offsite Backup
Prior to 2004: ITS staff rotated AIT tapes in an AIT 4 tape autoloader offsite. Since 2004, when the AIT autoloader became flaky (now autoloader has been discarded as non-functioning), there has been no regular offsite backup rotation, as there was no portable media created at C3HUU. In Dec2009, an external eSATA/USB drive was acquired for use as an offsite backup of key files. Testing showed that there are several ways to use the external drive:One option is to make sure that ext3 formatted SATA drives are readable on other Linux servers. They certainly are on my TS-109 (which is the same architecture as the QNAP TS209 at C3HUU. Will also test on other Linux boxes. But if a staff member is to try to recover files, it will have to be on NTFS (or FAT32) formatted devices. We can try FAT32, though we are VERY reluctant to do so as FAT32 format is not nearly as reliable. Perhaps creating mirrors of FAT32 drives would be better? Another option is to install this Open Source project on at least one C3HUU PC supporting ext2/ext3 on Windows:
http://www.fs-driver.org/faq.html
Anyone had any experience with this?
Timings:
USB Backup Appliances
There have been many ITS people working in non-profits raving about the capabilities of several programs which run from USB external devices and perform very easy to initiate file backups that are also easy to recover. Here are several products we have acquired and reviewed, or volunteers working with us have reviewed:- Goodsync had an offer to users of Roboform (password vault software) that made the effective price for Goodsync approx $15/PC. This software can be setup to use any attached storage and run from the USB device (special license). MS did try this and though it works, rather than run from a dedicated USB device, 4 workstation licenses were acquired and are installed on 2 PCs at C3HUU at present. This software is intended to provide File backup and replace use of the Mirra server and Mirra client software. The USB version is also available to take to any number of PCs for backup, but relies on the physical USB flash key that the software is installed on to be present. Goodsync is more like the UNIX rsync tool than the dedicated backup software reviewed below. A bit more of a learning curve to setup than alternatives below, but can be automated and is straightforward to recover files from NAS device used for storage. RECOMMENDED and in use at C3H (2010-01-04)
- Clickfree: There are many versions of this core file backup product, we tried two USB versions. Software is launched when the USB key is inserted in the PC and stops when it is ejected. We can recommend the DVD Transformer, as long as you like to use DVD or CD media or the original Clickfree Transformer which is designed for use with USB hard disks. The newer Transformer SE product also supports iPods as well as just about any USB attached storage device that you can think. Transformer products do not require the USB device to recover files, and the license is for UNLIMITED use! You just have to physically have the USB device in order to perform a backup. However, the only security here is physical security. You should lock up the backup media as there is no support for encryption or password protection. RECOMMENDED but not in use at C3H (2010-01-04)
- USB Flash Backup: OK software that is licensed per PC, though installed on a USB device. Limited function compared to Goodsync, but reasonable price. RECOMMENDED but not in use at C3H (2010-01-04)
- QNAP NetBak Backup: included with all QNAP NAS devices. Very simple backup tool designed primarily to manage backup from one QNAP NAS device to another. In testing, this tool is designed for NAS devices only, it would not allow file backup to a local USB device if the user wished to do that. No file versioning supported at all. NOT RECOMMENDED, OK for home (2010-01-04)
- QNAP QBack-35s: One of many external drive "appliances" which integrate secure partition and backup. Like the Western Digital line, it is for one-at-a-time backup, not suited for office, multiple PC backup. NOT RECOMMENDED, OK for home (2010-01-04)
- JetFlash with Fingerprint scanning: unlike the first two, this has an encryption option that is quite powerful and easy to setup, BUT installing the security software results in changes to Windows login behaviour and can cause hangups in Windows Explorer. Uninstall was not clean on either of two XP test PCs. The included backup software is very simple, NOT RECOMMENDED (2010-01-04)
- Packaged Backup such as Western Digital MyBook: excellent options, for direct attach storage one PC at a time. Cost almost as much as the QNAP NAS with less function ($100+ for 320GB, which is current minimum available). So rather than deploy these at each PC, C3H ITS has elected to deploy a central NAS and configure tools to use that NAS which is then backed up periodically with the above noted inexpensive, simple removable 2.5" hard drive in inexpensive ($20) external housing. NOT RECOMMENDED, OK for home (2010-01-04)
TS-x09 integration